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SUBSTITUTE SPECIFICATION 



Digital camera 



Field of the Invention 

r0001l The present invention relates to a digital camera, particularly 

but not exclusively to a digital camera included in a mobile 
communications device. 



Background Art 

[0002] Digital cameras are well known in the art. Increasingly, 

digital-cameras are being incorporated into other devices, such as mobile 
telephone handsets and an example is described in WO-A-131892. 



Th e pr e s e nt invent i on s ee ks to prov i d e an improv e d digita l cam e ra. 
Summary of the Invention 

[0003] The present invention seeks to provide an improved digital 
camera. A ccording to the present invention there is provided a digital 
camera including an image quality indicator. 

r00041 This has the advantage that the user is provided with 

feedback to indicate whether the camera is ready to take a picture and, if 
not, to allow the user to take appropriate measures. 

[0005] The digital camera may include a display for displaying an 

image together with sa i d image quality indicator. The image quality 
indicator may indicate whether an image is optimal based on one or more 
image parameters, including light exposure, white balance and/or dark 
reference. 
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[0006] The digital camera may be incorporated into a mobile 

communications device, such as a mobile telephone handset. 

r00071 According to the present invention there is also provided a 

method of operating a digital camera comprising providing a user interface 
of sai4- the camera with an image quality indicator. The method may 
comprise capturing an image and displaying sai4 -the captured image, 
together with sa4# -the indicator. 

[0008] This has the advantage that the user is provided with an 

objective indication of image quality. 

[0009] The method may further comprise executing one or more 

algorithms for determining the quality of sai4 -the image, such as 
determining light exposure forsa4d -the image, performing white balance of 
said the image and/or determining a dark reference for said the image. 
The method may comprise determining whether said -the one or more 
algorithms have found a stable solution. 

1*00101 According to the present invention there is still further 

provided a computer program for performing said -the method. 

room According to the present invention there is also provided a 

digital camera comprising an image sensor, a conversion circuit for 
receiving signals from the image sensor and producing an image signal, a 
display for receiving the image signal and outputting an image 
corresponding to the image signal and a control circuit for controlling the 
image sensor, the conversion circuit and the display, wherein the control 
circuit includes a processor configured to determine quality of the image 
signal and to produce a signal for indicating to a user whether the image 
signal satisfies one or more image quality conditions. 



Brief Description of the Drawings 

[0012] An embodiment of the present invention will now be 

described, by way of example, with reference to the accompanying 
drawings in which: 

[0013] Figur e Fig. 1a shows the front of a mobile communications 

device; 

[0014] F i gur e Fig. 1 b shows the reverse a mobile communications 

device; 

1*00151 F i gur e Fig. 2 is a schematic diagram of mobile 

communications circuitry; 

1*00161 F i gur e Fig. 3 shows an LCD displaying an image captured by 

a digital camera with an indicator of image quality; 

r0017] F i gur e Fig. 4 is a schematic diagram of a 3-bit register; 

[0018] F i gur e Fig. 5 illustrates a process by which the quality of an 

image is determined and the indicator is displayed; 

[0019] Figur e Fig. 6 shows an image of optimal quality; 

[0020] Figure Fig. 7 shows an image of near-optimal quality; 

[0021] Figur e Fig. 8 shows an image of poor quality; 

[0022] Figur e Fig. 9 shows an image of very poor quality; and 

r00231 Figur e Fig. 10 is a schematic diagram of an arrangement of a 

digital camera unit, a processor, memory and display. 

Description of the Preferred Embodiment of the Invention 

[0024] F i gur e Fig. 1a shows the front of a mobile communications 

device in the form of a mobile telephone handset 1, which is sometimes 
referred to as a cellular telephone handset. The handset 1 includes a 
microphone 2, keypad 3, liquid crystal display (LCD) 4 and speaker 5. 
The LCD 4 and speaker 5 form part of a user interface. 



[0025] F i gur e Fig. 1 b shows the reverse side of the handset 1 . The 

handset 1 includes a detachable battery 6 for powering the handset 1 and 
a digital camera unit 7. The digital camera unit 7 is suitable for capturing 



still and moving images and comprises a lens, an image sensor, such as a 
complementary metal oxide semiconductor (CMOS) sensor and an 
analogue-to-digital (ADC) converter for supplying digital image data. 

[0026] F i gure Fig. 2 illustrates circuitry included in the handset 1. 

Signal processing is carried out under the control of a digital 
microcontroller 8 which has an associated RAM/ROM 9 and flash memory 
10. Electrical analogue audio signals are produced by the microphone 2 
and amplified by a pre-amplifier 1 1 . Similarly, analogue audio signals are 
fed to the speaker 5 through an amplifier 12. The microcontroller 8 
receives instruction signals from the keypad 3 and controls operation of 
the LCD 4 and flash memory 10. 

[0027] Information concerning the identity of the user is held on a 

smart card 13 in the form of a GSM SIM card which contains the usual 
GSM international mobile subscriber identity and encryption Kj that is used 
for encoding the radio transmission in a manner well known perse. The 
SIM card 13Js removably received in a SIM card reader 14. Radio signals 
are transmitted and received by means of the antenna 15 connected 
through a frf^ RF stage 16 to a codec 17 configured to process signals 
under the control of a microcontroller 8. 

r00281 Image data captured by the digital camera unit 7 is processed 

by the microcontroller 8 and held in flash memory 10. The flash memory 
10 may be in the form of a removable "memory stick". The handset 1 may 
also be provided with a dedicated image processor (not shown) so as to 
reduce processing load on the microcontroller 8. Thus, the handset 1 may 
operate as a digital camera capable of capturing and storing still and/or 
moving pictures. 

[0029] An overview of digital cameras is given in "Complete Guide to 

Digital Cameras" by Michael Murie (Prompt Publications, 1999). 



r00301 F i gur e Fig. 3 shows LCD 4 when the handset 1 is in a camera 

state, which is sometimes known as "camera mode". An image 18, in this 
example a picture of a boat, is captured by the camera unit 7 ( F i gur e 
Fig. 1 ) and is displayed by the microcontroller 8 in an image window 1 9. 
The image window 19 includes an indicator 20 in the form of a three-level 
bar. The indicator 20 specifies whether the handset 1 is able to capture 
an image of optimum quality in terms of exposure, white balance and dark 
reference. The image 18 is provided with a header 21 which allows the 
user to label the image 18. 

r00311 The image window 19 is used as a viewfinder to help the user 

to compose a picture. The user directs the camera unit 7 ( Figur e Fig. 1) at 
a subject or scene, while the handset 1 automatically performs exposure 
control, adjusts white balance and determines dark reference using 
algorithms which are known per se. In this example, the microprocessor 
8, in conjunction with the camera unit 7, executes the algorithms. 

[0032] An exposure control algorithm, which is often referred to as 

auto-exposure or simply "AE", is analogous to shutter speed control on a 
film camera, but in the case of a CMOS sensor it adjusts pixel integration 
time and the various gain blocks in the system to satisfy the luminance of 
the scene and, if appropriate, to reject flicker due to lighting running off an 
alternating current source. 

[0033] A white balance algorithm, which is often referred to as auto- 
white balance or simply "AWB", attempts to adjust gains on the red, green 
and blue colour channels to correct imbalances caused by the spectral 
content of the scene illumination. 

[0034] A dark calibration algorithm attempts to subtract from a 

captured image the effects of dark current, which is the pixel leakage 



current. This quantity varies markedly with temperature. Information on 
the dark current is often derived from several rows or columns of pixels 
outside the usable image area which are masked to exclude ambient light. 

[0035] Generally, a stable solution to each algorithm is found by 

holding the handset 1 steady and allowing the handset 1 to try different 
conditions and settle on a set of solutions which represent an optimal 
image. However, the handset 1 will have difficulty determining the optimal 
image, if the subject or scene comprises for example moving objects or 
both high and low levels of lighting. 

r00361 According to the present invention, the user is provided with 

feedback to indicate whether the handset 1 is ready to take a picture, i.e. 
whether the algorithms have converged, and, if not, to allow the user to 
take appropriate measures, such as holding the handset 1 steady. 

1*00371 Figur e Fig. 4 shows a control register 22 comprising first, 

second and third flags 23a, 23b, 23c which represent whether or not a 
stable solution of each algorithm has been found. In this case a flag set to 
"1" represents a stable solution. At one extreme, if all three flags 23a, 
23b, 23c are set to "1", then the user is informed by shading all three 
levels 2d, 20 2 , 20 3 of the indicator 20 (Figure 3). At the other extreme, if 
none of the flags 23a, 23b, 23c are set, then none of the levels 20i, 20 2 , 
20 3 are shaded. 

1*00381 A process by which image quality is assessed and feedback 

provided will now be described: 

[0039] Referring to F i gur e Fig. 5. an image is captured by the 

camera unit 7 ( F i gur e Fig. 1 ) and displayed in the image window 19 
( F i gur e Fig. 3) (step S1). The microcontroller 8 executes the exposure 
control algorithm (step S2) and determines it has converged (step S3). If 



so, the first flag 23a is set to "1" indicating "stable" (step S4.1), otherwise, 
it is set to "0" indicating "not stable" (step S4.2). The microcontroller 8 
runs a white balance algorithm (step S5)(step S6). If the algorithm 
converges, the second flag 23b is set to "1" indicating "stable" (step S7.1), 
otherwise, it is set to "0" indicating "not stable" (step S7.2). The 
microcontroller 8 runs a dark calibration algorithm (step S8) (step S9). If 
stable, the third flag 23c is set to "1" (step S10.1), otherwise, it is set to "0" 
(step S10.2). 

[0040] The microcontroller 8 then checks the state of the register 22. 

1*00411 Initially, the microcontroller 8 checks whether the three flags 

23a, 23b, 23c of the register 22 are set to "stable" (step S1 1 ). If so, all 
three stages 2d, 20 2 , 20 3 of the indicator 20 are shaded (step 12). Thus, 
the indicator appears as a fully-filled vertical bar. An example of an LCD 4 
showing an optimal-quality image 18, with all three stages 20 1f 20 2 , 20 3 of 
the indicator 20 shaded, is shown in Figur e Fig. 6. 

[0042] If the first test fails, the microcontroller 8 checks whether any 

two of the flags 23a, 23b, 23c are set to "stable" (step S13). If two flags 
are set, then first and second levels 2d, 20 2 of the indicator 20 are 
shaded (step S14). Thus, the indicator 20 appears as a bar which is two- 
thirds filled. An example of an LCD 4 showing a near-optimal quality 
image 18 is shown in Figur e Fig. 7. 

r00431 If the second test fails, the microcontroller 8 checks whether 

any one of the flags 23a, 23b, 23c is set to "stable" (step S15). If one of 
the flags 23a, 23b, 23c is set, then the first stage 2d of the indictor 20 is 
shaded (step S16). Thus, the indicator 20 appears as a bar which is only 
one-third filled. An example of an LCD 4 showing a poor quality image 18 
is shown in F i gur e Fig. 8. 



r00441 If all of the tests fail and none of the flags 23a, 23b, 23c are 

set, then no part of the indicator 20 is shaded (step S17), as shown in 
F i gur e Fig. 9. 

[0045] The microcontroller 8 determines whether a key on the 

keypad 3 has been pressed (step S18). If a key has been pressed, then 
the image 18 is captured and stored in flash memory 10. Otherwise, the 
process returns to step S1. 

r00461 This process has the advantage that the user is provided with 

real-time feedback as to the quality of the image 18 being captured. If the 
image 18 is of poor quality, then further exposure control and/or white 
balancing and/or dark calibration is needed. This may be remedied by 
holding the camera steady for a period of time, such as a few seconds, or 
re-composing the picture. 

1*00471 The microcontroller 8 performs the process described earlier 

under the control of a computer program stored in RAM/ROM 9, which is 
loaded and executed when handset 1 enters the camera state. It will be 
appreciated that the process may be executed by a dedicated image 
processor, which may itself be included in the camera unit 7. 

r00481 Referring to F i gur e Fig. 10. an arrangement of the digital 

camera unit 7, microprocessor 8, RAM/ROM 9 and LCD 4 is shown. 

r00491 The digital camera unit 7 includes a CMOS sensor 24 and an 

analogue-to-digital converter (ADC) 25. The CMOS sensor receives light 
26 and generates a corresponding electrical signal 27 which is converted 
into an image signal 28. The image signal 28 is fed to the microcontroller 
8 which operates display driving software 29 which provides a display 
signal 30 to the display 4. 



rOOSOl The microcontroller 8 executes first, second and third routines 

31, 32, 33. The first routine 31 performs the exposure control algorithm 
which encompasses steps S2 to S4 of the process shown in Figur e Fig. 5. 
The second routine 32 performs the white balancing algorithm which 
generally covers steps S5 to S7 of the process shown in F i gur e Fig. 5. 
The third routine 33 performs the dark reference algorithm which is 
broadly encompasses steps S8 to S10. While performing the algorithms, 
the microcontroller 8 exchanges signals 34, 35, 36 with the camera unit 7. 
For example, the first routine 31 receives light levels and sends 
instructions regarding pixel integration time. The second routine 32 
receives colour color channel information and sends instructions to adjust 
gain for each colour color channel. The third routine 33 receives 
information regarding pixel leakage and sends instructions to subtract this 
from the electrical signal 27. 

1*00511 First, second and third algorithm results 37, 38, 39 are sent to 

the register 22. In this example, the register 22 is held in RAM, although it 
could be held in the controller's memory (not shown). 

[0052] The microcontroller 8 executes a fourth routine 40 which 

checks the content of the register 22 as outlined in steps S11 to S17 of 
the process shown in Figure 5. The fourth routine 40 produces a signal 41 
which is fed to the display driver 29 for displaying the indicator 20 
appropriate to the content of the register 22. 

r00531 It will be appreciated that step S2 to S10 and steps S1 1 to 

S17 need not be executed by the same processor and, in particular by the 
microcontroller 8. For example, steps S2 to S10 may be performed by a 
processor embedded in the camera unit 7. 

[0054] It will be appreciated that many modifications may be made to 

the embodiment described above. For example, the digital camera unit 
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may be mounted anywhere on the handset, for example on the front side 
of the handset or connected to the handset via a cable. The image sensor 
may comprise a different type of sensor, such as a charge coupled device 
(CCD). 

[0055] Rather than determine whether a stable solution has been 

found, other criteria may be used to determine whether an image is ready 
to be captured. These criteria may include numerical thresholds or 
ranges. 

[0056] Different shapes of indicators may be used such as a circular 

pie-chart. One or more flags may be used and one or more levels can be 
displayed. The number of flags need not equal the number of levels. The 
indicator may comprise multico l our e d multicolored indicator. Thus, for 
example a green shape may signify a picture of optimal quality picture, an 
amber shape may represent a near-optimal quality picture and a red 
shape may indicate a poor-quality picture. The indicator may be multi- 
shaped. Thus, a tick or check may signify an optimal-quality picture. 

r00571 Additionally or alternatively, an audio signal may be provided 

as an indicator of image quality. This may comprise spoken words such 
as "ready" or "not ready", different tunes or tones of varying pitch. 
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Abstract 
Digital camera 

A digital camera is incorporated into a mobile telephone handset. An 
image window, used as a viewfinder, includes an indicator in the form of a 
three-part bar for showing whether an optimal image can be captured. 
Exposure, white balance and dark reference are determined using 
algorithms executed by the handset. 



(Figur e 3) 



